Spatial PixelCNN: Generating Images from Patches
نویسندگان
چکیده
In this paper we propose Spatial PixelCNN, a conditional autoregressive model that generates images from small patches. By conditioning on a grid of pixel coordinates and global features extracted from a Variational Autoencoder (VAE), we are able to train on patches of images, and reproduce the full-sized image. We show that it not only allows for generating high quality samples at the same resolution as the underlying dataset, but is also capable of upscaling images to arbitrary resolutions (tested at resolutions up to 50×) on the MNIST dataset. Compared to a PixelCNN++ baseline, Spatial PixelCNN quantitatively and qualitatively achieves similar performance on the MNIST dataset.
منابع مشابه
Parallel Multiscale Autoregressive Density Estimation
PixelCNN achieves state-of-the-art results in density estimation for natural images. Although training is fast, inference is costly, requiring one network evaluation per pixel; O(N) for N pixels. This can be sped up by caching activations, but still involves generating each pixel sequentially. In this work, we propose a parallelized PixelCNN that allows more efficient inference by modeling cert...
متن کاملUnsupervised Holistic Image Generation from Key Local Patches
We introduce a new problem of generating an image based on a small number of key local patches without any geometric prior. In this work, key local patches are defined as informative regions of the target object or scene. This is a challenging problem since it requires generating realistic images and predicting locations of parts at the same time. We construct adversarial networks to tackle thi...
متن کاملPixelCNN Models with Auxiliary Variables for Natural Image Modeling
We study probabilistic models of natural images and extend the autoregressive family of PixelCNN architectures by incorporating auxiliary variables. Subsequently, we describe two new generative image models that exploit different image transformations as auxiliary variables: a quantized grayscale view of the image or a multi-resolution image pyramid. The proposed models tackle two known shortco...
متن کاملکمیسازی تغییرات الگوی مکانی سیمای سرزمین در زیستگاه سیاه خروس قفقازی (Tetrao mlokosiewiczi) در ذخیرگاه زیستکره ارسباران
Large scale land use/cover changes and habitat fragmentation have been associated with the decline of many wildlife populations in ecological sensitive regions. The main goal of this study was to quantify the spatial pattern changes in Caucasian Black Grouse habitat in Arasbaran Biosphere Reserve, Northwest of Iran in a period of 24 years (1987–2011). Caucasian black grouse (Tetrao mlokosiewicz...
متن کاملGenerating Interpretable Images with Controllable Structure
We demonstrate improved text-to-image synthesis with controllable object locations using an extension of Pixel Convolutional Neural Networks (PixelCNN). In addition to conditioning on text, we show how the model can generate images conditioned on part keypoints and segmentation masks. The character-level text encoder and image generation network are jointly trained end-to-end via maximum likeli...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- CoRR
دوره abs/1712.00714 شماره
صفحات -
تاریخ انتشار 2017